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(54) Apparatus and method for performing semantic concurrency control in dispatching client 
requests within a server in a client/server computer system 



(57) An apparatus for dispatching client requests for 
execution by a server object in a heterogeneous object- 
oriented client/server computing environment, the ap- 
paratus has: a request-holding buffer having an input 
connected to a communications channel which chan- 
nels the client requests to the apparatus, and an output; 
a plurality of parallel execution threads connected to the 
output of the buffer; and a semantic concurrency control 



means for examining the semantics of a request in the 
buffer and the semantics of each request presently be- 
ing executed on any of the plurality of parallel execution 
threads, and for delaying the request from being dis- 
patched from the buffer to an execution thread if the ex- 
amined semantics of the requests indicate that such dis- 
patch would cause conflicting access to the server ob- 
jects resources. 
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Description 

Field of the Invention 

[0001] The invention relates to the field of client/serv- 
er (also known as "distributed") computing, where one 
computing device ('the client") requests another com- 
puting device ("the server") to perform part of the client's 

work. 

Background of the Invention 

[0002] Client/server computing has become more 
and more important over the past few years in the infor- 
mation technology world. This type of distributed com- 
puting allows one machine to delegate some of its work 
to another machine that might be, for example, better 
suited to perform that work. 

[0003] The benefits of client/server computing have 
been even further enhanced by the use of a well-known 
computer programming technology called object-orient- 
ed programming (OOP), which allows the client and 
server to be located on different (heterogeneous) "Plat- 
forms". A platform is a combination of the specific hard- 
ware/software/operating system/communication proto- 
col which a machine uses to do its work. OOP allows 
the client application program and server application 
program to operate on their own platforms without wor- 
rying how the client application's work requests will be 
communicated and accepted by the server application. 
Likewise, the server application does not have to worry 
about how the OOP system will receive, translate and 
send the server application's processing results back to 
the requesting client application. 
[0004] Details of how OOP techniques have been in- 
tegrated with heterogeneous client/server systems are 
explained in US Patent No. 5,440,744 and European 
Patent Published Application No. EP 0 677,943 A2. 
These latter two publications are hereby incorporated 
by reference. However, an example, of the basic archi- 
tecture will be given below for contextual understanding 
of the invention's environment. 
[0005] As shown in Fig. 1, the client computer 10 
(which could, for example, be a personal computer hav- 
ing the IBM OS/2 operating system installed thereon) 
has an application program 40 running on its operating 
system ("IBM" and "OS/2" are trademarks of the Inter- 
national Business Machines corporation). The applica- 
tion program 40 will periodically require work to be per- 
formed on the server computer 20 and/or data to be re- 
turned from the server 20 for subsequent use by the ap- 
plication program 40. The server computer 20 can be, 
for example, a high-powered mainframe computer run- 
ning on IBM's MVS operating system CMVS" is also a 
trademark of the IBM corp.). For the purposes of the 
present invention it is irrelevant whether the requests for 
communications services to be carried out by the server 
are instigated by user interaction with the first applica- 



tion program 40, or whether the application program 40 
operates independently of user interaction and makes 
the requests automatically during the running of the pro- 
gram. 

5 [0006] When the client computer 10 wishes to make 
a request for the server computer 20's services, the first 
application program 40 informs the first logic means 50 
of the service required. It may for example do this by 
sending the first logic means the name of a remote pro- 

10 cedure along with a list of input and output parameters. 
The first logic means 50 then handles the task of estab- 
lishing the necessary communications with the second 
computer 20 with reference to definitions of the available 
communications services stored in the storage device 

*s 60. All the possible services are defined as a cohesive 
framework of object classes 70, these classes being de- 
rived from a single object class. Defining the services in 
this way gives rise to a great number of advantages in 
terms of performance and reusability. 

20 [0007] To establish the necessary communication 
with the server 20, the first logic means 50 determines 
which object class in the framework needs to be used, 
and then creates an instance of that object, a message 
being sent to that object so as to cause that object to 

25 invoke one of its methods. This gives rise to the estab- 
lishment of the connection with the server computer 20 
via the connection means 80, and the subsequent send- 
ing of a request to the second logic means 90. 
[0008] The second logic means 90 then passes the 

30 request on to the second application program 100 (here- 
after called the service application) running on the serv- 
er computer 20 so that the service application 100 can 
perform the specific task required by that request, such 
as running a data retrieval procedure. Once this task has 

3S been completed the service application may need to 
send results back to the first computer 10. The server 
application 100 interacts with the second logic means 
90 during the performance of the requested tasks and 
when results are to be sent back to the first computer 

*o 10. The second logic means 90 establishes instances 
of objects, and invokes appropriate methods of those 
objects, as and when required by the server application 
100, the object instances being created from the cohe- 
sive framework of object classes stored in the storage 

45 device 110. 

[0009] Using the above technique, the client applica- 
tion program 40 is not exposed to the communications 
architecture. Further the service application 100 is in- 
voked through the standard mechanism for its environ- 

so ment; it does not know that it is being invoked remotely. 
[0010] The Object Management Group (OMG) is an 
international consortium of organizations involved in 
various aspects of client/server computing on heteroge- 
neous platforms as is shown in Fig. 1 . The OMG has set 

55 forth published standards by which client computers (e. 
g. 1 0) communicate (in OOP form) with server machines 
(e.g. 20). As part of these standards, an Object Request 
Broker has been defined, which provides the object-ori- 
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ented bridge between the client and the server ma- 
chines. The ORB decouples the client and server appli- 
cations from the object oriented implementation details, 
performing at least part of the work of the first and sec- 
end logic means 50 and 90 as well as the connection s 
means 80. 

[0011] Fig. 2 shows a conventional architecture for 
such a system. Once client requests find their way 
through the ORB 21 and into the server, the ORB finds 
a particular server object capable of executing the re- 10 
quest and sends the request to that server object's ob- 
ject adapter 22 (also defined by OMG standard) where 
it is stored in the object adapter's buffer to await 
processing by the server object. The server object has 
a plurality of parallel execution threads (23a, 23b, 23c) is 
upon any of which it can run an instance of itself. In this 
way, the server object is able to process plural requests 
at the same time. The object adapter 22 looks to see 
which of the parallel execution threads is ready to proc- 
ess another request and then assigns one of the re* 20 
quests to the next available execution thread. This is ex- 
plained in the above-mentioned US Patent as a "dis- 
patching" mechanism whereby the server dispatches 
requests to execution threads. 

[001 2] The OMG-standard server architecture of Fig. 25 
2 finds particular utility in the field of transaction 
processing. Computer implemented transaction 
processing systems are used for critical business tasks 
in a number of industries. A transaction defines a single 
unit of work that must either be fully completed or fully 30 
purged without action. For example, in the case of a 
bank automated teller machine from which a customer 
seeks to withdraw money, the actions of issuing the 
money, reducing the balance of money on hand in the 
machine and reducing the customer's bank balance 35 
must all occur or none of them must occur. Failure of 
one of the subordinate actbns would lead to inconsist- 
ency between the records and the actual occurrences. 
[0013] Distributed transaction processing involves a 
transaction that affects resources at more than one 40 
physical or logical location. In the above example, a 
transaction affects resources managed at the local au- 
tomated teller device as well as bank balances man- 
aged by a bank's main computer. Such transactions in- 
volve one particular client computer (e.g. 10 in Fig. 1) *s 
communicating with one particular server computer (e. 
g., 20) over a series of client requests which are proc- 
essed by the server. 

[0014] In typical client/server systems, client and 
server systems are each contributing to the overall so 
processing of such transactions. Further, many different 
clients may be concurrently attempting to use the same 
6erver to engage in separate transactions. For example, 
many different banking ATM machines (client systems) 
may be trying to concurrently begin transactions 60 as ss 
to access data from a popular database program run- 
ning on the bank's targe central server In some of these 
situations, the server must be able to isolate these con- 



current transactions so that they do not affect each oth- 
er. That is, until one transaction is finished (either all 
parts are committed or alt parts are aborted) other trans- 
actions trying to access the same server objects must 
be made to wait. 

[0015] For example, if a husband is trying to transfer 
$2000 from a family's checking account into the family's 
higher interest paying savings account at an ATM ma- 
chine at one bank on one side of town and his wife is 
attempting to perform the same transaction at another 
ATM (owned by a different bank) on the other side of 
town, the server must be able to deal with this situation 
effectively so that the two concurrent transactions do not 
create a problem for the bank owning the database serv- 
er. 

[0016] The way this problem is typically solved is for 
the server database program to perform transactional 
locking on concurrent accesses. That is, the database 
management system (DBMS) of the server would lock 
access to the family's account data stored in the data- 
base once a first client (e.g. the husband's ATM) re- 
quests access. Then, the husband's transaction would 
continue in isolation despite the fact that the wife's trans- 
action has been requested concurrently. The wife's cli- 
ent ATM would not be granted access to the data be- 
cause the husband's client ATM would already have a 
lock on the data. 

[0017] Placing the concurrency control responsibility 
in the server application (i.e. in the DBMS) has worked 
fine for database servers as discussed above which al- 
ready have the complex locking techniques integrated 
into their management system software. However, if 
other types of applications are to be used, the above 
system requires that the server application programmer 
include the complex locking schemes into his/her pro- 
gram while writing the object-oriented program. Also, 
the programmer must have an in-depth knowledge of 
transaction theory in order to be able to create the ap- 
propriate transaction context into the concurrency con- 
trol aspects of the program. 

[0018] To overcome this problem, the International 
Business Machines Corporation (IBM) has filed a patent 
application (UK Patent Application No. 9701566.3) on 
25 January 1997, which discloses a method whereby 
transactional locking is performed within the ORB (21 of 
Fig. 2). That is, as each client request comes through 
the ORB 21 on the way to the object adapter 22, the 
method determines whether a lock on server resources 
is necessary and obtains such a lock if the locks will not 
conflict with currently held locks. If a conflict exists, the 
incoming request must wait until the currently held, con- 
flicting lock (from a previous request) is released. 
[0019] In both of these prior approaches, however, it 
is necessary to obtain locks on server resources in order 
to carry out concurrency control. The processing steps 
involved in obtaining such locks are as follows. First, an 
incoming request is dispatched to an available thread 
and thus an instance of the server object is instantiated. 
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Second, local storage for this particular instance of the 
server object is obtained for this thread. Third, the pro- 
gram and data associated with the server object is load- 
ed into the storage. Fourth, the relevant file is accessed 
for execution. Finally, after all of the above four steps 
are carried out, a lock is obtained on the server object 
to ensure that subsequent requests will not be allowed 
to conflict with this request's access to the server ob- 
ject's resources. For the next dispatched request, the 
first four steps are carried out and if this request requires 
access to a locked resource, the request must wait until 
the lock on the server object from the first request has 
been released. 

[0020] The use of locks to perform concurrency con- 
trol often results in an inefficient use of central processor 
unit (cpu) resources, especially as the number of con- 
current requests increases. For example, assume that 
2000 users are all sharing the same exchange rate ob- 
ject and that 1999 of them are clients that would like to 
obtain the most recent value of a popular exchange rate 
(e.g., from United States dollars to United Kingdom 
pounds sterling) and one user is requesting to update 
the value of the exchange rate. The use of locks results 
in 2000 threads being used and 2000 local storage ar- 
eas being allocated. A very large number of cpu 
processing cycles is required in dispatching this many 
requests onto threads, obtaining this many storage ar- 
eas, loading the large number of programs and access- 
ing the large number of files. Thus, a great need exists 
in this art for a more efficient way to dispatch client re- 
quests. 

Disclosure of the Invention 

[0021] According to one aspect, the present invention 
provides an apparatus for dispatching client requests for 
execution by a server object in a heterogeneous object- 
oriented client/server computing environment, the ap- 
paratus has: a request-holding buffer having an input 
connected to a communications channel which chan- 
nels the client requests to the apparatus, and an output; 
a plurality of parallel execution threads connected to the 
output of the buffer; and a semantic concurrency control 
means for examining the semantics of a request in the 
buffer and the semantics of each request presently be- 
ing executed on any of the plurality of parallel execution 
threads, and for delaying the request from being dis- 
patched from the buffer to an execution thread if the ex- 
amined semantics of the requests indicate that such dis- 
patch would cause conflicting access to the server ob- 
ject's resources. 

[0022] Preferably, the buffer is included within an ob- 
ject adapter Further preferably, the communications 
channel includes an object request broker. Further pref- 
erably, the semantic concurrency control means also 
takes into account the state of the server object in mak- 
ing a determination as to whether the dispatch of a re- 
quest in the buffer would conflict with a request that has 



already been dispatched to a thread. 
[0023] According to a second aspect, the present in- 
vention provides a method of dispatching client requests 
for execution by a server object in a heterogeneous ob- 

5 ject-oriented client/server computing environment, hav- 
ing the steps of: examining the semantics of a request 
in a request-holding buffer having an input connected to 
a communications channel which channels the client re- 
quests to the apparatus, and an output; examining the 

'0 semantics of each request presently being executed on 
any of a plurality of parallel execution threads connected 
to the output of the buffer; and delaying the request from 
being dispatched from the buffer to an execution thread 
if the examined semantics of the requests indicate that 

*5 such dispatch would cause conflicting access to the 
server object's resources. 

[0024] According to a third aspect, the present inven- 
tion provides a computer program product for, when run 
on a computer, carrying out the method of the second 

20 aspect of the invention. 

[0025] Thus, with the present invention, as there is no 
need to obtain locks on the server object resources, con- 
currency control of a server object with respect to client 
requests received at the server can be carried out in a 

25 highly efficient manner, with a very large savings in cpu 
processing cycles. Specifically, when locks are ob- 
tained, all requests in the buffer are dispatched to 
threads, storage is allocated for each dispatched re- 
quest and other associated processing takes place for 

30 each dispatched request. However, with the present in- 
vention, a request is not dispatched from the buffer (and 
no storage is allocated for the request) until it is deter- 
mined that the request will not involve a conflicting ac- 
cess to the server object resource with respect to other 

35 requests that are presently executing on a thread. 

Brief Description of the Drawings 

[0026] The above-described invention will be better 
40 understood by reference to the detailed description of a 
preferred embodiment presented below, in conjunction 
with the following drawing figures: 

Figure 1 is a block diagram of a well-known heter- 
45 ogeneous client/server architecture using object 
technology, in the context of which the present in- 
vention can be applied; 

Figure 2 is a block diagram of a server architecture 
so according to a conventional design; 

Figure 3 is a block diagram of a server architecture 
according to a preferred embodiment of the present 
invention; and 

55 

Figure 4 is a flow chart showing the processing 
steps involved according to a preferred embodi- 
ment of the present invent ton. 
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Detailed Description of the Preferred Embodiment 

[0027] In the preferred embodiment of Fig. 3, requests 
received at the server process from client processes are 
first received by the server's ORB 31 . ORB 31 then s 
passes on requests destined to a particular server ob- 
ject to that server object's object adapter 32. This server 
object has a number of parallel execution threads 33a, 
33b and 33c where different instances of the server ob- 
ject can be running in parallel, in order to execute a large 
number of client requests. This is all analogous to the 
prior art of Fig.2 that was described above. 
[0028] An extra software unit is added to the prior art 
of Fig. 2, according to the present invention's preferred 
embodiment of Fig. 3. This extra unit is a concurrency 
control unit 34 which receives an input from the object 
adapter 32 and from each of the execution threads 33a 
to 33c and provides an output to the object adapter 32. 
The concurrency control unit 34 performs the function 
of making sure that a client request in the object adapter 
32 is not dispatched to an execution thread if doing so 
would result in conflicting access to the server object's 
resources. 

[0029] In the example that will be described hereinbe- 
low to illustrate the operation of this preferred embodi- 
ment, the server object will represent a bank account. 
Thus, the various requests that will be discussed are re- 
quests to access a particular bank account. One request 
is from a client ATM (automated teller machine) to with- 
draw funds from this account. This request is from the 
person owning the account who wishes to withdraw 
some funds. A second request is from an official of the 
bank who is requesting to find out the amount of over- 
draft that is associated with the bank account (perhaps 
the account balance is getting close to zero and the bank 
official is concerned that the account will go into the red). 
A third request is from another client ATM to check the 
balance of the account. This request is from the account 
owner's wife, who is on the other side of town from the 
owner at another client ATM machine. 
[0030] The concurrency control unit 34 takes an input 
from the request at the top of the buffer in object adapter 
32 (the request that is next in line to be dispatched to 
an execution thread 33a, 33b or 33c) in order to deter- 
mine the semantics of this request. That is, the concur- 
rency control unit 34 determines whether this request is 
requesting read access to the bank account object, write 
access to the bank account object, or neither read nor 
write access to the bank account object. 
[0031] The concurrency control unit 34 also takes in- 
puts from each of the execution threads 33a. 33b and 
33c in order to determine the semantics of the requests 
that are currently being executed on the threads. That 
is, the concurrency control unit 34 determines whether 
each request being executed on a thread involves read 
access to the bank account object, write access to the 
bank account object, or neither read nor write access to 
the bank account object. 



[0032] The concurrency control unit 34 then com- 
pares the semantics of the request at the top of the ob- 
ject adapter (32) buffer to the semantics of each of the 
requests being presently executed on each of the exe- 
cution threads (33a, 33b t 33c). The concurrency control 
unit 34 only allows the top request to be dispatched from 
the buffer to an available thread if the dispatching of this 
request would not result in a conflicting access to the 
server object resource. 

[0033] For example, if the top request in the buffer is 
the wife's request to check the balance of the bank ac- 
count, the concurrency control unit 34 checks the se- 
mantics of this request and determines that this is a read 
request. The request is seeking only to read the balance 
of the bank account (not to change the value of anything 
in the database associated with the account). Now, if the 
only request executing on any of the execution threads 
(say, thread 33a) is the request of the bank official to 
check the prearranged overdraft on the account, the 
concurrency control unit 34 checks the semantics of this 
request and again determines that it is a read request 
(no stored values need be altered to simply obtain the 
overdraft value and return it to the official). Since these 
two requests are both read requests, the concurrency 
control unit 34 dispatches the top request in the object 
adapter 32 to one of the other threads (say, th read 33b). 
[0034] If, however, the account owner's request to 
withdraw money is presently being executed on thread 
33a, and the top request in object adapter 32 is the ac- 
count owner's wife's request to check the balance of this 
account, a different result is achieved. Because the se- 
mantics of the presently executing request on thread 
33a indicate that this is a write request (as it will result 
in lowering the balance of the bank account), the top 
request in the object adapter buffer (which is seeking to 
read the same value) is not dispatched to a thread but 
is instead made to wait until the request executing on 
thread 33a is finished. 

[0035] The steps carried out by the preferred embod- 
iment of the present invention are illustrated in the flow- 
chart of Fig. 4. 

[0036] At step 41 , the concurrency control unit 34 ex- 
amines the semantics of the top request sitting in the 
buffer of the object adapter 32 (this is the request which 
is next to be dispatched from the buffer). That is, the unit 
34 determines whether this request is requesting read 
or write access to the server object resource. 
[0037] At step 42, the unit 34 examines the semantics 
of the requests presently executing on each of the exe- 
cution threads 33a, 33b and 33c. That is, the unit 34 
determines whether each of these requests is perform- 
ing read or write access to the server object resource. 
[0038] At step 43, the unit 34 uses the information that 
it has gathered from steps 41 and 42 in order to deter- 
mine whether the top request can be dispatched (step 
44) to one of the available execution threads, or whether 
it should be made to wait (step 45) until the execution 
of at least one of the presently executing requests has 
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finished accessing the server object resource. The way 
this is done is that if a read request is awaiting dispatch 
at the top of the buffer and all of the presently executing 
requests are also read requests, then the read request 
can be dispatched to an available thread for concurrent 
execution, as there is no conflict between concurrent 
read operations on the same server object resource. 
However, there is a conflict when a write operation is 
concurrently executing along with another write opera- 
tion or with a read operation. Thus, the unit 34 would 
delay the dispatch of the top request in the object adapt- 
er 32 if this latter situation would exist upon dispatch. 
[0039] Depending on the nature of the server object, 
the concurrency control unit 34 can also consider the 
present state of the server object in making a decision 
as to whether to allow a request to be dispatched. For 
example, assume that the server object is a queue with 
each element of the queue being separately addressa- 
ble for read/write purposes. One request from a first 
transaction is requesting to read the element at the front 
of the queue and this request has already been dis- 
patched to an execution thread. Now, a second request 
(that is awaiting dispatch) that is requesting to write to 
the last element of the queue can be concurrently dis- 
patched to the same server object, even though this sec- 
ond request is requesting write access to the same serv- 
er object that the first request has already been granted 
read access to (provided that the queue is non-empty). 
This is because the second request, albeit a write re- 
quest, is not conflicting with the first request (which is a 
read request). Since the server object is made up of plu- 
ral elements, each of these elements can be accessed 
separately by different requests without conflicting with 
each other. 

[0040] Also, the concurrency control unit 34 does not 
need to always consider only the top request in the buff- 
er as the next candidate for dispatch. The unit 34 can 
examine all of the requests in the buffer and take them 
out of order for dispatch. 

Claims 

1 . An apparatus for dispatching client requests for ex- 
ecution by a server object in a heterogeneous ob- 
ject-oriented client/server computing environment, 
the apparatus comprising: 

a request-holding buffer having an input con- 
nected to a communications channel which 
channels the client requests to the apparatus, 
and an output; 

a plurality of parallel execution threads con- 
nected to the output of the buffer; and 

a semantic concurrency control means for ex- 
amining the semantics of a request in the buffer 



and the semantics of each request presently 
being executed on any of the plurality of parallel 
execution threads, and for delaying the request 
from being dispatched from the buffer to an ex- 
s ecution thread if the examined semantics of the 

requests indicate that such dispatch would 
cause conflicting access to the server object's 
resources. 

10 2. The apparatus of claim 1 wherein said buffer is in- 
cluded within an object adapter. 

3. The apparatus of claim 1 wherein the communica- 
tions channel includes an object request broker. 

15 

4. The apparatus of claim 1 wherein the semantic con- 
currency control means also takes into account the 
state of the server object in making a determination 
as to whether the dispatch of a request in the buffer 

20 would conflict with a request that has already been 
dispatched to a thread. 

5. A method of dispatching client requests for execu- 
tion by a server object in a heterogeneous object- 

25 oriented client/server computing environment, 
comprising the steps of: 

examining the semantics of a request in a re- 
quest-holding buffer having an input connected 
^0 to a communications channel which channels 

the client requests to the apparatus, and an out- 
put; 

examining the semantics of each request pres- 
35 ently being executed on any of a plurality of par- 

allel execution threads connected to the output 
of the buffer; and 

delaying the request from being dispatched 
40 from the buffer to an execution thread if the ex- 

amined semantics of the requests indicate that 
such dispatch would cause conflicting access 
to the server object's resources. 

45 6. The method of claim 5 wherein said buffer is includ- 
ed within an object adapter. 

7. The method of claim 5 wherein the communications 
channel includes an object request broker. 

so 

B. A computer program product stored on a computer 
readable storage medium for, when run on a com- 
puter, carrying out a method of dispatching client 
requests for execution by a server object in a het- 
55 erogeneous object-oriented client/server comput- 
ing environment, the method comprising the steps 
' of: 



6 




11 



EP 0 936 544 A2 



12 



examining the semantics ot a request in a re- 
quest-holding buffer having an input connected 
to a communications channel which channels 
the client requests to the apparatus, and an out- 
put; 



5 



examining the semantics of each request pres- 
ently being executed on any of a plurality of par- 
allel execution threads connected to the output 
of the buffer; and 



10 



delaying the request from being dispatched 
from the buffer to an execution thread if the ex- 
amined semantics of the requests indicate that 
such dispatch would cause conflicting access is 
to the server object's resources. 

9. The product of claim 8 wherein said buffer is includ- 
ed within an object adapter. 



10. The product of claim 8 wherein the communications 
channel includes an object request broker. 
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